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A  STEADY-STATE  VERSION  OF  A  DYNAMIC 
OPTIMAL  BUDGETING  PROBLEM 

by 

Richard  M.  Soland 


1 .  Introduction 

Our  starting  point  in  this  paper  is  a  previously  developed  model 
for  a  dynamic  optimal  budgeting  problem  that  was  stated,  along  with 
several  related  models,  by  Clark  (1983)  and  analyzed  by  Falk  and 
McCormick  (1983).  It  is  model  2.0  in  the  nomenclature  of  Clark  (1983), 
and  it  seeks  to  maximize  a  measure  of  the  effective  asset  value  of  owned 
resources.  These  resources  change  over  time  from  period  to  period  ac¬ 
cording  to  specified  relations  and  the  amounts  of  procurement  and  of 
maintenance  and  manpower  supplied. 

Upon  observing  that  the  relations  connecting  variables  in  adja¬ 
cent  time  periods  are  nearly  independent  of  the  specific  time  periods, 
we  thought  it  of  interest  to  examine  a  simpler  model,  in  which  they  are 
completely  independent  of  the  specific  time  periods,  and  to  analyze  this 
model  under  the  assumption  that  steady-state  values  are  obtained  as  the 
number  of  time  periods  increases  without  limit.  Such  analysis  consti¬ 
tutes  the  main  part  of  this  paper. 
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An  outline  of  the  paper  is  as  follows.  In  Section  2  we  present 
the  dynamic  model  and  briefly  explain  its  variables  and  the  relations 
between  them;  this  is  done  in  order  to  make  the  present  work  self- 
contained.  In  Section  3  we  derive  and  justify  the  steady-state  model, 
henceforth  called  model  2.1,  and  in  Section  4  we  simplify  and  condense 
it  in  order  to  essentially  solve  it  in  closed  form.  Sections  5  and  6 
analyze  model  2.1  with  two  different  objective  functions,  leading  to 
models  2.1(A)  and  2.1(B),  respectively,  and  show  how  to  numerically 
obtain  optimal  solutions.  Optimal  solutions  are  provided  for  both  the 
input  data  of  Clark  (1983)  and  the  (slightly  different)  data  of  Falk  and 
McCormick  (1983) .  The  final  section  offers  some  tentative  conclusions 
and  suggests  several  directions  for  further  study. 

2 .  The  Dynamic  Model 

The  dynamic  model  is  composed  of  state  variables,  control  vari¬ 
ables,  and  the  relations  between  them.  There  are  also  initial  values  of 
the  state  variables  and  numerical  parameters  to  be  treated  as  data.  The 
state  and  control  variables  are  as  follows. 


State  variables: 


B 


t 


budget  in  period  t 


P 


procurement  in  period  t 


t 


MX 


maintenance  demanded  in  period  t 


t 


MXS^  maintenance  supplied  in  period  t 
MBLOG^  maintenance  backlog  in  period  t 
Mj_  manpower  demanded  in  period  t 


2  - 
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MSt  manpower  supplied  in  period  t 
AVt  asset  value  in  period  t 

Rt  asset  value  retired  in  period  t 

EAV^  effective  asset  value  in  period  t 

Control  variables: 

fraction  of  maintenance  supplied  to  total  maintenance 
demanded,  in  period  t 

fraction  of  manpower  supplied  to  manpower  demanded,  in 
period  t • 

F^t  and  are  restricted  to  the  interval  [0,1]  ,  while  the  state 

variables  are  only  required  to  be  nonnegative.  The  index  t  takes 
values  1,2,...  . 

We  now  present  the  relations  that  link  the  variables  in  various 
time  periods.  To  the  right  of  each  relation  is  an  appropriate  explanatory 
phrase,  but  some  additional  explanation  will  also  be  given  below.  In 
examining  these  relations,  one  should  note  that  they  are  all  defini¬ 
tional  in  nature,  as  opposed  to  expressing  constraints  on  the  variables. 
Indeed,  the  only  real  constraints  on  the  variables  are  those  simple  ones 
stated  above. 


Relations  of  model  2.0: 


Bt 

-  B02(1  +  al> 

Budget  in  period  t 

(i) 

Mt 

-  ca6(l  +  «5)eAV 

Manpower  demanded 

(2) 

MS 

II 

/-S 

K> 

rt 

K 

rt 

Manpower  supplied 

(3) 

-  3  - 
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MX 

=  VAVi  -  V1BL0Gt-l) 

Maintenance  demanded 

(4) 

MXSt 

=  (Flt) (MBLOGt_1  +  MXt) 

Maintenance  supplied 

(5) 

MBLOGt 

a2 

=  (a3)  MBLOGt_1  +  MXfc  -  MXSfc 

Maintenance  backlog 

(6) 

P 

t 

"  Bt  -  "“t  -  MSt 

Procurement 

(7) 

Rt 

=  (1  -  a3)AVt_1 

Retiring  asset  value 

(8) 

AVt 

=  AVt_1  +  Pt  -  R, 

Asset  value. 

(9) 

Relation  (1)  shows  the  budget  to  be  growing  at  a  rate  of  a^  ; 

Bq2  is  the  initial  budget.  Relation  (2)  shows  manpower  demanded  to  be 
directly  proportional  to  asset  value  in  the  previous  period,  while  (3) 
indicates  that  manpower  supplied  is  simply  some  fraction  of  that 
demanded . 

Relations  (4)  and  (5)  are  similar  to  (2)  and  (3),  respectively, 
but  for  maintenance  demanded  and  supplied;  the  relationships  are  a  bit 
more  complex  in  that  the  maintenance  backlog  also  enters  into  them. 
Relation  (6)  updates  the  maintenance  backlog. 

Relation  (7)  defines  procurement  as  that  amount  left  after  man¬ 
power  and  maintenance  have  been  supplied,  and  (8)  specifies  the  asset 
value  retired  as  a  given  fraction  of  asset  value  in  the  previous  period. 
Relation  (9)  updates  the  asset  value. 

Before  further  discussion  of  this  model,  it  is  appropriate  here 
to  list  the  currently  estimated  values  of  the  parameters  and  initial 
values  that  appear  in  (1)  -  (9) ,  as  supplied  by  Clark  (1983) . 


-  4  - 
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Parameter  values : 
a  =  0.03 

a2  -  2.0 

a3  =  0.95 

a^  =  0.04 

a^  =  -0.01 

a,  =  25  x  io-6 
6 

ay  =  0.5 

c  =  1200 
Initial  values : 

B02  =  10 

AVq  =  100 

MBLOGq  =  1 

Falk  and  McCormick  (1983)  used  an  earlier  estimated  set  of  value 

which,  however,  differs  only  in  using  a^  =  29/30  and  c  =  1000  . 

The  relations  (1)  -  (9)  can  be  greatly  condensed  through  simple 
substitution  and  elimination;  e.g.,  B  in  (7)  can  be  replaced  by  the 
right-hand  side  of  (1) ,  M  in  (3)  can  be  replaced  by  the  right-hand 
side  of  (2),  etc.  Equally  important,  the  control  variables  F.  and 
F2t  can  be  eliminated  by  using  MSt  and  MXSt  as  control  variables 
and  replacing  relations  (3)  and  (5)  by  the  following  two: 

MS  <  M 

-  5  - 


(3’) 
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MXS  <  MBLOG  +  MX  . 
t  t  t 


(5') 


This  is  justified  by  the  requirement  that  all  variables  be  nonnegative. 

Falk  and  McCormick  (1983)  have  used  this  approach  to  reduce  (1)  - 
(9)  to  a  set  of  four  linear  constraints  involving  nonnegative  variables. 
They  then  considered  a  particular  objective  function,  one  we  treat  in 
Section  6,  and  completely  solved  an  approximate  version  of  model  2.0 
covering  five  time  periods.  We  will  also  use  this  approach,  but  only 
after  passing  to  a  steady-state  version  of  model  2.0;  this  is  the  sub¬ 
ject  of  the  next  section. 

3 .  The  Steady-state  Model 

Examination  of  relations  (1)  -  (9),  with  either  (3)  and  (5)  or 
(31)  and  (5’),  shows  that  there  is  very  little  dependence  on  the  actual 
value  of  t  (as  opposed  to  the  change  from  t-1  to  t  ) ;  it  exists  only 
in  relations  (1)  and  (2),  by  virtue  of  the  terms  (1  +  a, ) ^  and 
(1  +  a5)C  ,  respectively.  Since  the  values  of  a^  and  a 5  are  rather 
small  in  magnitude  (the  current  estimates  are  a^  =  0.03  and  a,.  = 

-0.01  ),  over  a  fairly  short  time  horizon  relations  (1)  and  (2)  are 
nearly  independent  of  the  actual  value  of  t  .  It  is  therefore  of  inter¬ 
est  to  examine  a  version  of  model  2.0  in  which  =  0  so  that  the 

recursion  relations  are  independent  of  the  actual  time  periods. 


Under  the  assumption  a^  =  a,.  =  0  ,  (1)  reduces  to  Bt  =  BQ2  for  1 


all  t  and  (2)  becomes  Mfc  =  c^AV^  ,  where  cfi  =  ca^  .  Relation  (1) 
is  now  redundant,  and  we  are  left  with  the  following: 


M 


(10) 


t 


6 
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MS 

<  M 

(ID 

MX 

=  a, A V.  -  -  a-a-MBLOG^  , 

4  t-1  4  7  t-1 

(12) 

MXSt 

<  MBL0Gt  +  MX 

(13) 

a 

MBL0Gt 

=  (a3)  T1BL0G  +  MX  -  MXSt 

(14) 

P 

t 

■  B02  -  ““t  -  MSt 

(15) 

R 

t 

'  (1  -  a3)AVt-l 

(16) 

AVt 

-  AVi  +  pt  -  Rt 

(17) 

Now  suppose  we  append  to  model  2.0  an  objective  function  of  the 


form 


where  v  is  a  measure  of  effectiveness  in  period  t  .  It  is  certainly 
equivalent  to  consider  the  average  value  objective  function 


V(T) 


(18) 


We  now  make  the  additional  assumption  that  v  has  the  same  al¬ 
gebraic  form  for  all  t  and  depends  on  t  through  its  dependence  on 
the  values  of  the  state  and  control  variables  in  period  t  .  It  then 
seems  likely  that  the  optimal  value  of  V(T)  approaches  a  limit  as  T 
approaches  infinity  and,  more  importantly,  that  the  optimal  values  of 
the  control  and  state  variables  also  approach  limits  as  T  approaches 
infinity.  Assuming  the  existence  of  such  limiting  optimal  values,  we 
denote  them  by  simply  omitting  the  subscript  t  (we  also  set  B  =  BQ2  ) . 
These  limiting  values  then  satisfy  relations  obtained  from  (10)  -  (17) 
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by  omitting  the  subscripts  t  and  t-1  .  We  thus  obtain  the  following 
relations : 


M 

c6AV 

(19) 

MS  < 

M 

(20) 

MX 

a.AV  -  a,  a-,MBL0G 

4  4  7 

(21) 

MXS  < 

MBLOG  +  MX 

(22) 

MBLOG  = 

a2 

(a  )  MBLOG  +  MX  -  MXS 

(23) 

P 

B  -  MXS  -  MS 

(24) 

R 

(1  -  a3)AV 

(25) 

AV 

AV  +  P  -  R 

(26) 

AV,  M,  MS,  MX,  MXS,  MBLOG,  P,  R  >  0  , 

(27) 

B  >  0  is  given. 

We  refer  to  the  model  specified  by  (19)  -  (27)  as  (steady-state) 
model  2.1;  we  proceed  to  analyze  it  below.  Note  first,  however,  that 
our  rationale  for  examination  of  model  2.1,  especially  with  an  appropriate 
objective  function,  is  to  gain  insight  into  the  nature  of  optimal  solu¬ 
tions  when  relations  (10)  -  (17)  are  used,  which  in  turn  approximate 
(dynamic)  model  2.0. 

4 .  Closed-form  Solution  of  the 
Steady-state  Model 

In  this  section  we  greatly  simplify  model  2.1  through  substitution 
and  condensation,  much  in  the  way  that  Falk  and  McCormick  (1983)  simpli¬ 
fied  model  2.0.  We  are  able  to  go  significantly  further,  however,  because 
of  the  fact  that  model  2.1  is  time- independent , 
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We  first  replace  M  in  (20)  by  c^-AV  and  eliminate  (19) .  We 
also  replace  R  in  (26)  by  a3AV  ,  where  =  1  -  ,  and  eliminate 

(25) .  Then  (26)  yields  P  =  R  =  a^AV  ,  so  we  replace  P  in  (24)  by 
a^AV  and  eliminate  (26) .  Solving  (23)  for  MX  ,  we  obtain 

MX  =  MXS  4-  a^MBLOG  ,  (28) 

a2 

where  =  1  -  (a^)  >  0  .  Thus  we  eliminate  (23)  and  substitute  the 

right-hand  side  of  (28)  for  MX  into  (21)  and  (22),  yielding,  respec¬ 
tively, 

MXS  =  a4AV  -  a2yMBL0G  ,  '(29) 

MXS  <  (1  +  a23)MBL0G  +  MXS  ,  (30) 

where  =  a4a7  +  a23  '  Relation  (30)  is  clearly  redundant,  and  so  is 

eliminated.  We  now  replace  MXS  in  (24)  by  the  right-hand  side  of  (29) 

nonnega- 

(31) 

(32) 

(33) 

(34) 

(35) 

(36) 


and  add  the  constraint  that  the  right-hand  side  of  (29)  must  be 
tive.  We  are  then  left  with  the  following  relations: 

MS  <  M  [from  (20)] 
a4AV  -  a2?MBL0G  >  0  [from  (29)] 

a34AV  +  MS  -  a2?MBL0G  =  B  [from  (24)]  , 

AV,  M,  MS,  MBLOG  >  0  , 

where  a»,  =  a„  +  a.  . 

34  -  3  4 

Now  define  the  ratios 


x2  =  MBLOG/AV 


x3  =  MS/M  . 

Then  (31)  and  (34)  imply  0  <  x  <  1  ,  and  (32)  and  (34)  imply 
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0  <  x2  <  • 

In  (33)  we  now  substitute  MS  =  Mx~  =  c.AVx0 

3  6  3 

[by 

(19) ]  and  MBLOG 

=  AVx^  to  obtain 

AV(a34  +  c6x3  -  a27x2)  =  B  . 

(37) 

Solving  (37)  for 

AV  ,  and  appending  the  constraints  on  x^  and 

x3  , 

model  2.1  is  now 

reduced  to  the  following: 

AV  =  b/ (a3^  -  a27x2  +  c^) 

(38) 

0  <  x2  <  a4/a27 

(39) 

0  <  x^  <  1  . 

(40) 

Expression 

(38)  gives  AV  in  closed  form  as  a  function  of 

x2 

and  ,  our  new  control  variables.  The  choice  of  and  x^  as 

control  variables  is  motivated  by  the  choices  of  effectiveness  functions 
that  we  shall  employ  in  the  following  two  sections.  In  each  case  the 
task  is  to  find  the  optimal  values  of  x2  and  x^  ;  once  these  are  de¬ 
termined  the  corresponding  values  of  all  state  variables  can  be  found 
from  (38)  and  the  relations  given  earlier.  Thus  relations  (38)  -  (40) 
provide  the  starting  point  for  the  optimality  analysis  of  steady— state 
model  2.1. 


5 .  Optimality  Analysis  of  Model  2.1(A) 

In  model  2.0(A)  (the  "A"  denotes  the  first  type  of  objective 
function)  each  function  v  is  of  the  form 

Vt  =  Wtft(AV  MBL0Gt»  Mt*  MSt) 

=  wtAVth2(x2t)h3(x3t)  , 
where  w  is  a  positive  weight, 


(41) 
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x2t  =  MBLOG  /AV  , 


x3t  -  MVMt 


is  a  strictly  decreasing  and  continuous  function  on  [0,1]  with 
h^CO)  =  1  and  h^Cl)  =  0  ,  and  h^  is  a  strictly  increasing  and  con¬ 
tinuous  function  on  [0,1]  with  h^(0)  =  0  and  h^(l)  -  1  . 

The  rationale  for  the  above  choice  is  as  follows.  In  each 
period  t  it  is  desired  to  have  AV^  as  large  as  possible,  but  if  this 
is  achieved  by  diverting  funds  away  from  needed  maintenance  and  manpower 
demands,  then  the  effective  asset  value,  EAVt  ,  is  less  than  AV  . 
Expression  (41)  gives  EAV^  as  AV^_  diminished  through  multiplication 
by  two  quantities  between  0  and  1,  h^  and  h^  ,  that  account  for  de¬ 
gradation  of  useful  asset  value  due  to  (1)  a  maintenance  backlog,  rela¬ 
tive  to  asset  value  ^2^X2t^  »  and  (2)  a  manpower  shortage  relative  to 
manpower  demanded  [h^x^)]  ■ 

The  current  choices  for  the  degradation  functions  h^  and  h^  are 
cumulative  beta  functions  of  the  following  form: 

P2 

h2(x2)  =  (1  +  p2x2)(l  -  x2)  ,  (42) 

p3 

h3(x3)  =  x3  (1  +  p3  -  P3x3)  ,  (43) 

where  p2  and  p3  are  parameters,  currently  estimated  at  p2  =  58  and 
P3  =  5  . 

Let  us  now  insert  v^  from  (41)  into  the  average  value  objective 
function  (18) ;  we  obtain 


V(T)  -  |  ^  VWx2t)h3<X3t> 


(44) 


-  11  - 
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T 

Suppose  that  the  positive  weights  w^  satisfy  w  =  T  and 

limt->oo  wt  =  1  .  Assuming  that  AVfc  +  AV  ,  x2t  ->  x 2  ,  and  x^t  x3  as 

t  ->  00  ,  we  see  that  as  T  +  00  ,  V(T)  approaches  the  limit 

VA  =  Va(x2,x3)  5  AVhh(x2)h3(x3)  .  (45) 

In  (45)  it  is  appropriate  to  write  VA(x2,x3)  5  since  (38)  shows  AV  to 

depend  solely  on  the  control  variables  x2  and  x3  . 

Thus  an  appropriate  objective  function  for  steady  state  model  2.1 
is  ^^x2’x3^  5  as  S^ven  by  (45),  and  so  we  henceforth  refer  to  the  fol¬ 
lowing  optimization  problem  as  model  2.1(A): 

Maximize  VA(x2>x3)  =  AV(x2 ,x3)h2 (x2)h3 (x3) 

subject  to  0  <  x2  <  a^/a^  , 

0  <  x3  <  1  . 

Model  2.1(A)  is  a  very  small  and  relatively  simple  nonlinear  pro¬ 
gramming  (NLP)  problem  and  might  perhaps  be  best  solved  by  traditional 
methods  of  NLP  [see,  e.g.,  McCormick  (1983)].  Because  of  the  simple 
structure  of  model  2.1(A),  however,  we  have  attempted  to  find  a  solution 
more  directly.  We  have  done  this  by  maximizing  instead  the  logarithm  of 
VA^X2’X3^  ’  an<^  t0  this  latter  we  have  (partially)  ignored  the  con¬ 
straints  (39)  and  (40)  and  set  the  two  first  partial  derivatives  of 
log  va(x2»x3^  t0  zero.  We  have  used  the  specific  forms  for  h2  and 
h3  given  by  (42)  and  (43) . 

Setting  the  two  first  partial  derivatives  of  log  V  (x9,x^)  to 
zero  yields  two  quadratic  equations  involving  x ^  and  x^  ,  so  no 
closed-form  solution  is  possible.  We  therefore  solved  the  respective 
quadratic  equations  for  each  variable  in  terms  of  the  other  one,  using 
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the  interval  constraints  0  <  x.  <  a,/aa_  and  0  <  x„  <  1  to  select 
the  appropriate  root,  and  thereby  obtained  a  rapidly  convergent  itera¬ 
tive  algorithm.  Regardless  of  starting  point,  it  yields  the  optimal 
values  of  and  x^  to  seven  significant  figures  after  only  three 

iterations.  It  remains,  actually,  to  check  the  boundary  conditions  of 
the  interval  constraints  on  x^  and  x^  ,  but  this  is  easy  to  do.  We 
have  11^(0)  =  0  and  h^Ca^/a^y)  is  extremely  small,  so  the  only  cases 
worthy  of  examination  are  those  where  x^  =  0  and/or  x^  =  1  .  But 
But  3 (log  va)/3x 2  >  0  at  x2  =  0  and  8 (log  va)/9x3  <  0  at  x^  =  1  , 
so  neither  X2  =  0  or  X3  =  1  can  yield  an  optimal  solution. 

To  verify  that  the  iterative  algorithm  sketched  above  does  indeed 
yield  a  local  optimum,  and  hence  a  global  optimum,  we  have  verified  nu¬ 
merically  that  the  Hessian  matrix  of  log  VA(X2»X3^  as  negative  defi¬ 
nite  at  the  solution  point  found. 

Table  1  presents  the  optimal  solutions  to  model  2.1(A)  for  both 
the  data  sets  of  Clark  (1983)  and  Falk  and  McCormick  (1983) .  Note  that 
in  both  cases  the  optimal  values  of  x^  and  x^  are  extremely  close  to 
0  and  1,  respectively.  Also  shown  in  Table  1  are  the  values  of 
^A^X2  =  X3  =  1)  5  these  are  only  about  0.1%  less  than  the  optimal 
values.  For  practical  purposes,  therefore,  the  optimal  solution  to  mod¬ 
el  2.1(A),  with  presently  available  data,  occurs  at  X2  =  0  ,  x^  =  1  . 
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TABLE  1 

SOLUTIONS  OF  MODEL  2.1(A) 


Variable 

Optimal  Value 

Near-optimal  Value 

(A)  Data  from  Falk  and 

McCormick  (1983) 

X2 

0.000259 

0.0 

X3 

0.9912 

1.0 

AV 

101.95 

101.69 

VA 

101.82 

101.69 

MBLOG 

0.0264 

0.0 

MX 

4.077 

4.068 

MXS 

4.076 

4.068 

M 

2.549 

2.542 

MS 

2.526 

2.542 

P,R 

3.398 

3.390 

B 

10.0 

10.0 

(B)  Data  from  Clark  (1983) 

X2 

0.000292 

0.0 

X3 

0.9914 

1.0 

AV 

83.54 

83.33 

VA 

83.43 

83.33 

MBLOG 

0.0244 

0.0 

MX 

3.341 

3.333 

MXS 

3.339 

3.333 

M 

2.506 

2.500 

MS 

2.484 

2.500 

P,R 

4.177 

4.167 

B 

10.0 

10.0 
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6 .  Optimality  Analysis  of  Model  2.1(B) 

In  model  2.0(B)  (the  "B"  denotes  the  second  type  of  objective 
function),  each  function  v  is  of  the  form 


vt  =  wtft(AVt,  MBL0Gt,  MSfc) 


(46) 


=  wtAVt  min{h2(x2t),  h3(x3t)}  , 

where  x2t’  hj*  and  ^3  were  defined  at  the  beginning  of  Sec¬ 

tion  5.  Thus  model  2.0(B)  differs  from  model  2.0(A)  in  that  the  product 
h^h^  is  now  replaced  by  minO^h^}  . 

The  rationale  for  the  objective  function  of  model  2.0(B),  as, 
compared  to  that  of  model  2.0(A),  is  that  the  minimum  of  h ^  and  h^  , 
as  opposed  to  their  product,  is  the  appropriate  quantity  by  which  to 
multiply  AVt  in  order  to  obtain  the  effective  asset  value. 

Now  insert  v^_  from  (46)  into  the  average  value  objective  func¬ 
tion  (18)  to  obtain 


V(T)  =  Y  l  wtAVt  min{h2(x2t)  ,  ^(x^)}  .  (47) 

As  in  Section  5,  we  suppose  that  the  positive  weights  w  satisfy 
T 

wfc  =  T  and  lin^^  w^  =  1  ,  and  we  assume  that  AV  AV  , 

x2fc  ->  x2  ,  and  x3t  x3  as  t  00  .  Then,  as  T  00  ,  V(T)  ap¬ 
proaches  the  limit 

VB  =  Vb^x2,x3^  =  AV  min^h2^x2^  ,h3^x3^  ‘  (48) 

Hence  another  appropriate  objective  function  for  steady  state 
model  2.1  is  Vg(x2,x3)  ,  as  given  by  (48),  and  we  henceforth  refer  to 
the  following  optimization  problem  as  model  2.1(B): 
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Maximize  VB(x2,x3)  =  AV(x2,x3)  min{h2 (x2) ,h3 (x3> } 

subject  to  0  <  x_  <  a./a..,  , 

2  4  27 

0  <  x3  <  1  . 

Model  2.1(B)  can  be  recast  as  a  relatively  simple  NLP  problem  in  several 
different  ways;  we  provide  just  one  such  approach  here.  Let  x^  = 
min{h2 (x2) ,h3 (x3) }  .  Then  model  2.1(B)  is  equivalent  to 

Maximize  x^AV(x2>x3) 

subject  to  x^  <  h2(x2)  , 

x4  *  h3<x3)  » 

0  <  x2  <  a^/ a2y  , 

0  <  x3  <  1  . 

We  may  instead  maximize  the  logarithm  of  the  objective  function 
x^^(x2>x3)  >  and5  letting  x^  =  log  x^  ,  we  have  the  equivalent  problem 

Maximize  x^  +  log  AV(x2,x3) 
subject  to  x5  <  log  h2(x2)  , 

x5  ^  log  h3(x3)  , 

0  <  x2  <  a4/a27  , 

0  <  x3  <  1  . 

Even  without  solving  model  2.1(B)  we  can  partly  characterize  an 
optimal  solution,  regardless  of  the  specific  forms  of  h2  and  h3  . 

We  phrase  the  result  as  a  lemma. 
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Lemma: 

Let  (x*,x*)  be  an  optimal  solution  to  model  2.1(B).  Then  either 
(a)  h2(x*)  =  h3(x*)  ,  or  (b)  x*  =  a^/a^  and  h3(x*)  <  h2(x*)  . 

Proof:  First  note  that,  by  (38),  AV  is  a  continuous  function  of 

(x2,x3)  ,  and  it  is  strictly  increasing  in  x2  and  strictly  decreasing 
in  x3  .  Now  suppose  h2(x*)  <  h3(x*)  .  Then  h3(x*)  >  0  ,  and  so  x*  >  0 
Hence  x3  may  be  decreased  to  x3  =  x*  -  e  >  0  ,  where  e  >  0  ,  so  that 
AV(x*,xp  >  AV(x*,x*)  and  h2(x*)  <  h3(x3)  .  Thus  (x*,x3)  is  a  better 
solution  than  (x*,x*)  ,  which  is  a  contradiction. 

Now  suppose  h3(x*)  <  h2(x*)  .  If  x*  <  ,  then,  by  an  ar¬ 

gument  similar  to  the  one  above,  x2  may  be  increased  to  x2  =  x*  +  £ 
to  yield  a  better  solution.  The  only  remaining  possibility  is  that 
h3 <  h2(x*)  and  x^  =  a^/a (and  this  does  not  occur  with  the 
currently  estimated  values  of  the  data) . 

Model  2.1(B)  is  equivalent  to  a  small  and  relatively  simple  NLP 
problem,  and  there  are  definite  advantages,  to  be  discussed  in  Section  7, 
in  solving  it  by  an  appropriate  NLP  code.  For  the  purposes  of  this  pa¬ 
per,  however,  we  solved  it  by  making  use  of  the  lemma  above.  Since 
h2(x*)  =  h3(x*)  it  suffices  to  maximize  AV[x2,g3(x2) ]h2(x2)  subject 
to  0  <  x2  <  ,  where  g3(xp  expresses  x3  as  a  function  of  x2 

from  the  condition  h2(xp  =  h3(x3)  =  h3[g3(x2)]  .  We  solved  this  opti¬ 
mization  problem  involving  x^  only  using  a  one-dimensional  search  and 
calculating  x3  =  g3(x2)  for  each  value  of  x2  tested. 
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TABLE  2 


SOLUTIONS  TO  MODEL  2.1(B) 


Variable 

Optimal  Value 

Near-optimal  Value 

(A) 

Data  from  Falk  and 

McCormick  (1983) 

x2 

0.00111 

0.0 

X3 

0.9882 

1.0 

AV 

102.10 

101.69 

VB 

101.89 

101.69 

MBLOG 

0.1133 

0.0 

MX 

4.082 

4.068 

MXS 

4.074 

4.068 

M 

2.552 

2.542 

MS 

2.522 

2.542 

P,R 

3.403 

3.390 

B 

10.0 

10.0 

(B)  Data  from  Clark  (1983) 

X2 

0.00113 

0.0 

X3 

0.9880 

1.0 

AV 

83.68 

83.33 

VB 

83.50 

83.33 

MBLOG 

0.0946 

0.0 

MX 

3.345 

3.333 

MXS 

3.336 

3.333 

M 

2.510 

2.500 

MS 

2.480 

2.500 

P,R 

4.184 

4.167 

B 

10.0 

10.0 
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Table  2  presents  the  optimal  solutions  to  model  2.1(B)  for  both 
the  data  sets  of  Clark  (1983)  and  Falk  and  McCormick  (1983) .  As  in  the 
solutions  to  model  2.1(A),  the  optimal  values  of  and  x^  are  ex¬ 

tremely  close  to  0  and  1,  respectively.  Also  shown  in  Table  2  are  the 
values  of  V_(x0  =  0,  x0  -  1)  ;  these  are  only  about  0.2%  less  than  the 
optimal  values.  For  practical  purposes,  therefore,  with  presently  avail¬ 
able  data  the  solution  x^  =  0  and  x^  =1  is  an  optimal  one  for  model 
2.1(B),  as  it  was  found  to  be  for  model  2.1(A). 

7 .  Conclusions  and  Suggestions  for  Further  Study 

Comparison  of  Tables  1  and  2  shows  that,  with  presently  available 
data,  models  2.1(A)  and  2.1(B)  yield  essentially  the  same  solution.  For 
practical  purposes  this  solution  is  x^  -  0  and  x^  -  1  .  This  situation 
will  change,  however,  if  certain  of  the  input  data  change  appropriately. 
For  example,  we  may  expect  the  optimal  solutions  to  depend  quite  heavily 
on  the  functions  h^  and  h^  .  As  an  illustration,  we  solved  models 
2.1(A)  and  2.1(B)  with  the  data  of  Falk  and  McCormick  (1983)  and  p^  of 
^2^X2^  Set  at  ^  instead  of  58.  This  has  the  effect  of  increasing  con¬ 
siderably  the  value  of  ^2^2^  for  x^  >  0  and  makes  a  mirror 

image  of  h^  .  The  results  are  shown  in  Table  3;  the  solutions  of  models 
2.1(A)  and  2.1(B)  are  no  longer  the  same,  and  they  yield  values  of 
and  x^  further  from  0  and  1,  respectively,  than  in  the  case  p^  =  58  . 

Falk  and  McCormick  (1983)  solved  model  2.0(B)  [i.e.,  model  2.0 
with  an  objective  function  of  the  form  (47)]  by  using  piecewise-linear 
approximations  to  h^  and  h^  .  The  dynamic  model  they  solved  had  five 
time  periods  and  used  the  initial  values  Bq  =  10  ,  AV^  =  100  , 
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TABLE  3 

SOLUTIONS  WITH  p2  =  5  AND  DATA  FROM 
FALK  AND  McCORMICK  (1983) 


Model 

2.1(A) 

Model 

2.1(B) 

Variable 

Optimal  Value 

Variable 

Optimal  Value 

x2 

0.0338 

x2 

0.0465 

X3 

0.9909 

X3 

0.9535 

AV 

105.03 

AV 

107.30 

VA 

103.26 

VB 

104.23 

MBLOGq  =  1  .  It  is  interesting,  and  encouraging,  to  note  that  the  opti¬ 
mal  solution  they  obtained  agrees  quite  closely  with  our  solution  to 
steady-state  model  2.1(B).  We  may  therefore  hope  that  in  many  cases 
the  solution  to  a  steady-state  model,  such  as  model  2.1(A)  or  model  2.1(B), 
will  yield  both  insight  into  the  nature  of  the  solution  of  a  corresponding 
dynamic  model  and  a  good  start  toward  the  exact  solution  of  that  model. 

Both  models  2.1(A)  and  2.1(B)  can  be  solved  as  relatively  simple 
NLP  problems,  and  a  number  of  different  algorithms  and  computer  codes 
could  be  used  to  solve  them  this  way  [see,  e.g.,  McCormick  (1983)].  There 
are  two  key  advantages  to  such  an  approach.  First,  the  use  of  a  depend¬ 
able  computer  code  is  likely  to  guarantee  a  correct  solution  and  avoid  both 
theoretical  and  numerical  errors  that  might  arise  in  developing  special¬ 
ized  algorithms.  This  should  be  important  as  we  proceed  to  more  complex 
steady-state  models,  to  be  discussed  below,  and  it  should  save  time  in 
finding  solutions  to  them.  A  computer  code  that  works  well  on  a  steady- 
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state  problem  might  then  be  applied  to  a  dynamic  version  of  that  problem 
in  order  to  find  a  solution  fairly  efficiently.  Second,  sensitivity 
analysis  of  NLP  problems  is  now  available  with  certain  computer  codes, 
and  this  would  provide  an  excellent  way  to  determine  the  sensitivity  of 
the  problem  optimal  solution  to  the  values  of  the  various  parameters . 

For  a  thorough  discussion  of  this  subject  see  Fiacco  (1983). 

Clark  (1983)  also  formulates  dynamic  model  3.0,  which  has  three 
sets  of  control  variables.  One  of  our  next  tasks  will  be  an  attempt  to 
derive  and  analyze  a  steady-state  version  of  this  model.  We  shall  also 
examine  asymptotic  versions  of  models  2.0  and  3.0  in  which  the  limiting 
growth  is  assumed  to  be  either  linear  or  exponential.  We  hope  to  derive 
limiting  models  that  are  analogous  to  steady-state  model  2.1  and  then 
analyze  them  in  conjunction  with  appropriate  objective  functions. 

Another  task  that  should  be  undertaken  is  the  rigorous  verifica¬ 
tion  of  the  limiting  behavior  we  have  assumed  in  this  paper. 
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